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Abstract 

It has been recently proven jl], ^) that natural images exhibit scaling 
properties analogue to those of turbulent flows. These properties allow 
regarding each image as a multifractal object Q), for which its most 
singular manifold conveys the most of the non-redundant structure. In 
the present work, we go further in this analysis, proposing a simple 
propagator that reconstructs the whole image from this set. This fact 
could have deep implications for biology, technology and statistical 
mechanics. 
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Our main motivation was the understanding of the coding strategies |J 
developed by biological neural systems, which has been a matter of great 
interest, specially in the case of the visual pathway [Q, ||. This problem has 
often been analyzed using the Information Theory background || 0], thus 
introducing a statistical treatment of the visual signal || . It is precisely a 
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statistical analysis based on a very different context (the Fully Developed 
Turbulence) which leads to the most interesting results. This scope pro- 
vides what seems a powerful new language; new for image analyists but well 
known for physicist in the field of turbulence. The structure of the paper is 
as follows: the theoretical basis about the turbulent-like statistics of natu- 
ral images is presented. This short review introduces the concept of Most 
Singular Manifold as a statistical essential in images. Then, a guess about 
how could this set be used to retrieve the whole image is issued and a simple 
interpretation of it is given. This guess is self-consistently used to check 
that multifractality is a robust, intrinsic property of natural images; and a 
possible interpretation of it, perhaps valid beyond this subject, is proposed. 

The work was developed on B/W images, although generalizations to 
coloured images could be done in the same way. We consider each image to 
be defined by the scalar field of its luminosities, I(x), although we will make 
use of the contrast c(x) = I(x) — (I(x))g. The main result of Q was to prove 
that that it is possible design intensive variables, related to the derivatives of 
c(x), which exhibit scaling laws known as Self Similarity (SS) and Extended 
Self Similarity (ESS). These properties are the same as those of turbulent 
flows, which allowed for using models developed in such a context. It is also 
possible reinterpret that result in terms of a multifractal measure [14, 
Very recently |2| has been established that for natural images the scalar 
density \Vc\ 2 (x)dx defines a multifractal measure, i.e.: The image may be 
decomposed as a collection of fractal sets (each having fractal dimension 
D(h)), formed by the points for which the measure scales locally as r . This 
characterization is observed indirectly by the scaling of p-moments related to 
the measure, which in turn shows the SS properties (as it is comprehensively 
described in @|). 

Our first step was to split an image into its different fractal sets. This can 
easily be done by means of the wavelet analysis (see |J) , as a multiresolution 
decompositon (see [[H], |llj). We followed the detailed technique presented 
in . One also needs to know the characteristic values of the multifractal 
(namely, the exponent associated to the Most Singular Manifold (MSM) 
{hoo = —0.5) and the fractal dimension of this set (D^ = 1.; see [||, §])). 
The analysis revealed that the MSM, F^, can be identified with what could 
naively be called "edges" of the objects present in the scene (see Figures |] 
and ^). More interestingly, the multiplicative process model |l2], [l3| used to 
describe multifractal structures [14, [D| suggests that there is a hierarchical 
organization of the different fractal manifolds in the image, as it is shown in 
Pj. The open question is if one of them (namely the MSM) contains enough 
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information to deterministically reconstruct the whole set. This is precisely 
the aim of this letter. 

We consider the gradient Vc(x) as our basic field. We would like to 
reconstruct the field c(x) for every x of the scene given the gradient on F^. 
Under the assumptions of translational invariance and linearity, one obtains: 

c(x) = / dl(y) g(x - y)Vc(y) (1) 



where g is the linear kernel of the desired propagator, and J F dl(y) means 
line integration along the MSM. This equation can be rewritten in a very 
useful form defining the field vq as 

v (x) = Vc(x)6 Foo (x) (2) 

where Sa(x) stands for the proper Hausdorff measure especialized to the set 
A. In this way, eq. (jl]) is elegantly expressed in the Fourier space as 

c{f)=Kf)-W) (3) 

which is an integral equation equivalent to eq. ([!]), but now the boundary 
conditions are contained in the vector field vq, which depends on the par- 
ticular image to be reconstructed. The crucial point in all that follows is to 
determine g. It is natural to require it to be isotropic, as the particularities 
of the image are already contained in vq, and we think that g is an universal 
propagator. This would imply g(f) oc /. To end with, we recall a well 
established property of natural images, namely the scaling of their power 



spectrum S(f) (see [16]), which is: 

S(f)^\c(fY-j^, (4) 

where rj is a non-universal, small exponent which depends on the particular 
image ensemble considered (see for instance |l7j). The simplest possible g 
is then given by: 



9(f) = is (5) 



P 

This is quite reasonable, because then |c(/)| = jA(f), where A(f) = 

l^o(/) ■ f\/f has a weak dependence on / and varies from one image to 
another, which could explain the small exponent rj in eq. (Q). In Figure || the 
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field c(x) obtained taking as -Fqo the set given in Figure [2] is represented. The 
performance is really good, although quality is lowered by the (unknown) 
filtering this image has. This is reasonable because filtering damages the 
natural propagation of light, thus the reconstruction will work up on non- 
processed natural images. For this we repeated the process with other, non- 
filtered images (see Figure || for one example). The general performance is 
good, although if one border is lost (at the time of edge detection, see ||) 
so is all the structure associated to it, which seems quite reasonable. 

Some remarks should be made about the guess for the kernel g(f) given 
by eq. (|5|). First, it is not so surprisingly simple. It is reasonable thinking 
about a tridimensional, stationary field of light intensity I(x, y, z) propagat- 
ing out the secundary sources of light that the objects represent. This scalar 
field sould hence verify AI = (J^j + + g^x)I = outside those objects. 
Under apropriate conditions, the projection of this field on a distant screen 
could verify that ~ at every point in the screen except those repre- 
senting the MSM projection. This would imply that the two-dimensional 
laplacian of the restriction of / to the screen should vanish except at the 
MSM. Then, the image could be reconstructed by Poissonian diffusion from 
the MSM, whose propagator is precisely eq. (|5|) for Neumann boundary con- 
ditions. 

Second, using the kernel of eq. (g) and no matter the image considered, 
eq. (H) allows reconstructing the correct c(x) provided that the set is 
large enough: Taking i 7 ^ as the whole image, eq. (|3|) turns out to be a trivial 
identity. It just seems that natural images allow taking a rather sparse set 
Foo: the MSM. 

This last remark could be used to enhance the performance of the re- 
construction, by making a more precise determination of the MSM. Eq. ([|), 
given the kernel eq. (||), implies that 

div(Vc-5 FSo ) =0 (6) 

Had the complementary of the MSM (F^) been an open set, eq. (||) 
would have been a simple Poisson equation on the contrast, the MSM being 
the source set. Then, operating the Laplacian on an image would make it 
vanish at every point except at those of the most singular manifold. This 
operation would allow a fast, direct way to isolate the MSM and the image 
would be reduced to a monofractal, one might say. In Figure |] such an 
operations is performed over Lena's image, leading to a set rather different 
than the MSM previously detected, Figure |2[ Moreover, the Laplacian-ed 
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images surprisingly still behave as multifractals, with the same characteristic 
parameters. We noticed this repeating the calculations done in [|J and in 0] 
over a set of images got from H. van Hateren (see and then observing 

their scaling properties (see Figure |6|). To explain this, one should notice 
that in fact the MSM is a dense set, so its complementary set cannot be open 
and eq. (||) does not allow for a direct splitting. It is also worth noticing 
that decorrelation of images (an important strategy in visual coding, see 
| |19f ) also produces multifractality of the same kind (see Figure ^ again) . 

Both transformations (laplacian and decorrelation) intend to be modifi- 
cations of the power spectrum, that is, the energy distribution by frequency 
of the image (see [16]). This is equivalent to multiply the kernel g(f) by f 2 



or / respectively, and use this new kernel to propagate from the MSM, ac- 
cording to eq. (H) . We could even think in a whole family of kernels g a which 
moduli would scale as f a , producing different (in principle) multifractals. 
Those kernels with moduli decaying faster than f~ l generate more saturated 
images, as the spatial light propagation would decay slower than with the 
reconstructor, eq. d); those ones decaying slower in the frequency domain 
generate images in which light estinguishes rather close to the source, F^. 
But disregarding the strenght of the propagation, the multifractal hierarchy 
remains the same (as partially shown in Figure ||). It seems that the MSM 
alone explains all the multifractal structure, being this essentially a geomet- 
rical property: in some sense, the singularity exponent h of each point has 
only to do with its geometrical situation with respect to alone. 
Then, the conclusions of our work are: 

1. Natural images are rather well described by a simple Poissonian diffu- 
sion of the light out of the Most Singular Manifold (MSM), being this 
a dense but sparse set in the image. 

2. In (2|, a conjecture on the relevance from the informational point of 
view of the MSM is issued. Our result shows that this could be true: 
the MSM would allow reconstructing the whole image. Given that 
maximization of the information transfer seems to be a very general 
learning issue for the sensorial pathways in living beings, this suggests 
that neural structures performing a codification based on detecting 
the MSM should be observed (what was first proposed in 0]). In fact, 
eq. (H) has much to do with decorrelation and edge detection, two 
known features performed by the visual neural circuits in mammals. 
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3. This coding process seems to be a very efficient one in image process- 
ing, which in turn could be useful in image engeneering. ( for instance, 
image compression, light sources modification, etc. ) 

4. Multifractality, at least for natural images, is explained by the only 
presence of the MSM. In this sense, the exponent associated to a point 
measures something like the local density of edges (segments of the 
MSM). This issue could easily be translated to other contexts ( for 
instance, to fully developed turbulence ). 
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Figure 2: Lena's most singular manifold 
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Figure 3: Lena's reconstruction from her most singular manifold 



10 




Figure 4: Image gotten after applying the laplacian on Lena's image. The 
greater is the absolute value, the brighter it is represented. ( A logarithmic 
transformation was performed in order to enhance the details ) 
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Figure 5: First row: (from left to right) 512x512 patches from Hans van 
Hateren's images imk01964.imc, imk04089.imc and imk03322.imc. Second 
row: their most singular manifolds, obtained as in Q. Third row: Their 
reconstructions. Note that the performance of the reconstruction is strongly 
determined by the quality of the edge-detection 
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Figure 6: ESS exponents p(p,2) for the original set (OS) of images and for 
the sets obtained after applying a decorrelating filter (DS) and a Laplacian 
filter (LS). They correspond to the horizontal (up) and the vertical (down) 
Local Linear Edge Variances. They were calculated in the same way as 
in HJ, for the sample formed by van Hateren's images imk01964.imc and 
imk04089.imc. The diamonds correspond to OS, the crosses to DS and the 
boxes to LS. The graphs almost perfectly overlap, which indicates that the 
multifractal structure is preserved under the transformations (as mentioned 
in the text). It is also observed a correspondence in the values between the 
horizontal and vertical exponents, from which we conclude that the set is 
isotropic with respect to the multifractality. 
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